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ABSTRACT 


This thesis is a comparative accuracy study of several 
discrete methods for lower confidence limits on series 
System reliability. Computer simulations were used to 
compare the accuracy of the procedures. Five hundred 
replications were used in all simulations. Accuracy of each 
procedure was determined by computing appropriate percentile 
points of the distributions of the lower confidence limits. 
A randomization technique was used to improve the performance 
of one of the procedures. 

The systems simulated had reliabilities ranging from 
0.720 to 0.950. They were composed of five, ten, thirteen, 
and fifteen components, and had component sample sizes of 
fifteen, thirty, fifty, and larger in the case of unequal 
sample sizes. 

Based on the simulation results the accuracy of the 
procedures were compared by common comparison with the true 


system reliabilities which were known in advance prior to 


the component tests. 
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s I. INTRODUCTION 


Suppose a complex mechanism, e.g., a Missile, is built 
. from a number of different types of components, where the 
reliability of each of the components has been estimated by 
means of separate tests on each of the components. There 
exist: many procedures for combining such component data to 
determine approximate lower confidence limits for the 
reliability of the system. Several such procedures are the 
Maximum Likelihood (Ref. 12), the Madansky (Ref. 5), the 
Log-Gamma (Ref. 13), the Easterling/Modified Maximum 
Likelihood (Ref. 2) and the Mann (Ref. 6) methods. 

This study is concerned with series system. Lower 
confidence limit accuracies are compared by means of computer 
simulation. Two methods of introducing partial component 
failures were used in the simulation to modify some of the 
procedures which cannot be used when all the components 
exhibit no failures. The first method was proposed by 
W. M. Woods and the second by Lisowsky (Ref. 4) who also 
developed a successful technique for computing the Lagrange 
multiplier in the Madansky procedure. An attempt was also 
made to improve the performance of the Easterling method 

‘ using randomization techniques developed by D. R. Barr and 
T. Jayachandran (Ref. 1). 


The simulation results show that the accuracy of the 


Maximum Likelihood, Madansky and Mann procedures are comparable, 





the Log-Gamma and Easterling procedures yield satisfactory 
results when sample sizes are large and unequal, and the 
Randomized Easterling procedure yields better results than 
the Easterling procedure in all cases. 

Finally, it is worthwhile to note that the Maximum 


Likelihood procedure is simple and easy to implement; 


therefore it can be used as a rough and ready method. 








II. DESCRIPTION OF THE METHODS 


Consider a system which consists of k components in 
logical series; the components may be either continuously 
operating or of the cycle type. 

Suppose n; copies of component i are put on test, i=l, 
2,...,K, under the environmental conditions defined in its 
mission profile, and let each operate until failure or the 
mission time is reached, whichever occurs first. Denote t. 
as the number of components of type i that did not complete 
the mission, and define 


a a 


inde ay (27,2) 
where 


A 


] 
a) 
~S 
3 


i Las 
The following methods were modified in Chapter III, 
section C, since some of the procedures cannot be used when 
all components exhibit no failure, i.e., the Madansky, the 


Easterling and the Randomized Easterling procedures. 


A. THE MAXIMUM LIKELIHOOD (ML) METHOD 
The maximum likelihood estimate for system reliability 
is 


D. (2.2) 


This estimator is asymptotically normal in distribution, and 


its variance is estimated by (Ref. 9): 





, k (n,-x.) 
on ae (2.3) 
i=l Lk 
s. 
. where x. = n,-f. 
4 eB 
The ML 100(1-a)% Lower Confidence Limit (LCL) for system 
reliability is given by 
Ret (a) = Rg - 24_,° (2.4) 
where Zin is the 100(l-a) percent point of the standard 
normal distribution. 
B. THE MADANSKY (MD) METHOD 
The Madansky method is based on the well-known results 
due to Wilks (Ref. 11) that -2 lnp is distributed asymptot- 
ically as a chi-square random variable with one degree of 
freedom. 
a oe is the likelihood ratio test statistic given by 
(Ref. 5). 
e k i. 
[max I BIN(x.;p.)|} I ps, = R,] (2.5) 
i=l iia ts eas = 
@) = 
k 
[max I BIN(x.;p.)] 
i=1 eo 
3 a i ee n.-X 
where BIN (x, 7D, ) (Py iiyip.) 2 “i 
i z 
Le 2 pa ee as 
The numerator is maximized under the additional constraint 
: k 
en Pp, = Ro, and 
a 


10 





the denominator is an unconstrained maximization. Values of 
» Ry included in the two sided confidence interval (the 


confidence set) are given by 


is ee 2 
s(R,) = [R,: 2° Ine -< Ma (2.6) 


where cee is the upper percent point of the chi-square 
, 
distribution with 1 degree of freedom. 


It is easy to see that the logarithm of the denominator 


of eis 
x, k A k k 
x in BIN (x; 7 ==) se. 2 Ine (o> eo od x, 1nx,; - <r x.l1ln ns 
i=l i i=l i i=l i=l 
k k 
+ (n.-x.) In (n.-x.) - = (n.-x,) Inn. 
sone hia 5 ee B ; pai a 
i=l i=l 


To determine the logarithm of the numerator ofe, let us 


~ 
first maximize the Lagrangian 
k kK 
- fin BIN(x,;; py) = A{iln 7. p,. = In R,} 
i=1 ops i=1 + . 
where i} is a Lagrange multiplier. The maximizing set of 
P,'s is given by 
X.-dX 
p. = ——, 
i n,-) 
where, since 0 <p; < 1 for all i, then A < min x,. 
. Hence, as a function of i, 





k k A 
Eoin BIN(x,; p;) = =© (2°) 
° i=1 <= a 
k k 
+x. In(x.-4) - £ x. In(n.-)) 
: i : i 
: i=l i=l 
k k 
+ 2 (n,-x,)in(n;-x,) - 2 (n,-x,) in(n;-A) 
i=l i=l 
and 
k r k r 
lnp = ¢£ x In(l - —) - ¢& ns In(l - aa (2.7) 
i=l *i 0 i=l i 


where \ satisfies the constraint equation 
(2.8) 


The set of ) such that -2 lnop < x2 L will be an interval 
Tr 


* * * * * ; 
[ As.» hol, where Ay < 0 < Ao and the A satisfy 


k 

A NS, oe 
a es a ag ee ee) 
L i. i=l 1 


The MD 100(l-a)% LCL is given by 


A ® 
Reru(a) = Rg (AQ) (2.10) 
In determining lower confidence limits the convention adopted 
by Myhre and Saunders (Ref. 12) will be used where the value 


of a in equation 2.9 is 


a = 2(l-y), 


and y is the confidence coefficient. 





Cx THE LOG-GAMMA (LG) METHOD 

In the LG procedure the method of moments is used to fit 
the random variable ~InkR, with the two parameter gamma 
distribution (Ref. 13). The gamma is then transformed into 
a chi-square distribution, about which probability statements 
are made and a lower confidence limit obtained. That is 


define 
in(1-q;) (2,11) 


Expanding the natural logarithm in an infinite series 


k 2 
zu [(-q,) - % (-q.) + 
i=l 


wack) 


169) 

i] 

I 
| bh 


and if each qi is small, the above series can be approximated 


by the first two terms of the infinite series. That is 


k k 
S= 2 [q, + @)/2] = 2 T, (2.12) 
i= t= 1 
where 2 
Fy 
oy > Sg 


It has been shown that the error due to the above truncation 
is negligible in cases of practical interest. 


An unbiased estimator T; for T, (Ref. 7) is 


a2 





a i 
where a; = 3745-7 (2.14) 
i 
. ao 
a 
That 7 is unbiased is important, because 
“a k An 
S= :£ fT, (2.16) 
, a 
1=1 


is used as an estimator for S, thereby accumulating any bias 
present in the T;- An approximate value for the variance of 


S (Ref. 7) is 


; P T, 

as = ak 
Var (S) = Var (T;) = = (2.27) 
Next, fit S with a gamma distribution. The probability 


distribution of S is then given by the density function 


fo (et ey 6)--= eee xr exp (-x/@6) (2.18) 


= r(ey6* 
x>0, r>0, 6>0 
It follows that 
E (S) = re (2.19) 


var (S) = ré° (2-00) 


Since S is unbiased 


E (S) =§ 


‘py (2.21) 





Solving equations (2.17), (2.19), 2.20) and (2.21) 


s simultaneously gives the shape parameter 


oe k T, 
— aes (2322) 


and the scale parameter 


k TS k 
— a i (2423) 
Thus, r can be estimated by 
«le: 252 FS & it, 
r= z T; x ae (2.24) 
i=1 i=l i 


Since S is distributed gamma (r,6), 2S/95 is distributed 


2 2 : 
Xor° Then ice, 2e is that number such that 


a el ee eee (2.25) 
And since S is unbiased 
E(S) = S$ 
= r6 (2°26) 


= -1nR, 


Equation 2.25 becomes 


és ee 2 
2 gn SP LES: > ink . X1-o, 20! 
: Le SP en | Re |- (ever) 
Xl-a,25 








Therefore, the LG 100(l-a)% LCL for system reliability R, is 


- ~2rs 
Re ula) = eXP | (2.28) 
x l-a,2r 


To preclude usage of non-integer degrees of freedom, 


the approximation 


(2rS] (2.29) 
Xi-a,[2r] 


is used in equation (2.28), where [2r] denotes the smallest 


a 


integer greater than or equal to 2©., Approximation (2.29) 


was shown to have little effect on the LG procedure accuracy 


(Ref. 7, p. 16). Thus, the 100 (l-a)% LCL becomes 
- 7 - [2r18 
Re ula) = exp | = (2.30) 
Xi-a,[2 4] 


A continuity correction is used in the LG procedure to 
improve the accuracy of the lower confidence limit. The 
reason for the inaccuracy of this lower confidence limit lies 
in the fact that a continuous distribution has been fitted 
to - ink. This type of correction has a smoothing effect 
upon the probability distribution of Rs h(a)- 
The continuity correction is made as follows: 


l. Determine that component i, which has the largest 


iL’ Lte=1, wee Ke 


sample size; il.e., ny 
fe) 


> Tn 





This means that one more failure is added to that component 
' 
with largest sample size to obtain T; 


35 Define Tt by 
° 


Te se ITS eRe 
1 1 1 
fe) fe) fe) 


4, Substitute TF for T, in Ste obtain S* 
oO. ° 
The resulting S*is the continuity corrected 


value of S, 


ae r igs corrected to obtain r* by substituting Ts 
; for am in the definition of r. 
. 6. With eee definitions of S* and r* the new 
100 (1l-a)% lower confidence limit RE h(a) for 





Re becomes 


Ak r ~(2r*] S*. 
Resta) =e a, (2.31) 


X1-a,[2r*] 





D. THE EASTERLING /MODIFIED MAXIMUM LIKELIHOOD (MML) METHOD 


In this method the ML estimate Rs is treated as the 
usual binomial estimate based on "n", called the pseudo sample 
size, is unknown and is estimated from 


-> | ORG (1 - R,) 
ge = SS (2.32) 


“a 


n 
where 5? is given by 2.3. Thus by equating the estimated 
variance of R. under maximum likelihood theory to what it 
would be under binomial theory, we can solve this equation 
for n. Then the component test results can be regarded as 
being equivalent to system results of n tests with x = Rien 
successes, 

In binomial sampling with x successes inn trials, a 


lower 100(1 - a)% confidence limit on the reliability is 


given by the solution for Rg in 


L ix, x, n-x+1) 54 (2,33) 


snore fs the incomplete beta function with 
x : the first parameter, and 
n- x + 1 : the second parameter. 
n and x are unlikely to be integers and the calculations of 
lower limits in the comparative examples (chapter IV) use 


Easterling's MML method in which n and x were rounded up to 


the next integers, 





E. THE RANDOMIZED EASTERLING (RE) METHOD 

Barr and Jayachandran in Ref, 1 develop a randomization 
technique for improving the lower confidence limit on the 
reliability of a system with a discrete distribution. 
Basically the method is a Simple one, for example an exact 
100(1 - a)% LCL for the parameter of the binomial distribution 
can be obtained as follows: 

1. Let z=x+y, where y represents an observed value of 
Y, and Y is uniformly distributed between zero and one 
inclusive; x is the number of successes inn trials. 


2. The solution for R, in 


Z (RL, 2, n-ztij)=a (2.34) 


s 
is the exact 100(1l-a)% LCL. 


Since the Easterling method leads to one component 
system, equation 2.34 is readily applicable for computing an 
exact 100(1-a)% LCL based on the Easterling method by 
replacing z with z in equation 2.35, where 
Z=xty 


and n with n, x and n as defined in equation 2.33. 


F. THE MANN (MN) METHOD 
Mann et al. in Ref. 6 shows that the 100(1l-a)% LCL on 
R, can be obtained by fitting the posterior distribution of 


~inR. with a noncentral chi-square distribution. The 


corresponding central chi-square variate with non-integer 


degrees of freedom is transformed to normality yielding: 





i 3 
a, > @Xp [=a [1-v/ (9m*) + a. otveai}]| = l-a (2.35) 


* where m is the mean and v the variance of the posterior 


distribution of ~inR,. 


1-R 
_ 0.5(1+1/a) s 
aan” Sai! OVS (Ri+1) see 
iy me Se ZS) (2.37) 
n 
with 
k 
a= st oi) res (1/n,), (2.38) 
i=l 
Nii) = min(nj+-+++ny), (2.539) 
a = -R )*111- 7 
n* = Ni) [1 0: EL R,) }i1=0.8. 2 RI, (2.40) 
“s and z,_, = 100(1-a)-th percentile of the standard normal 
distribution. 


All zero ~ failure components are ignored in calculating 
the value of a in equation 2.38 except for any single zero - 
failure component with its sample size equal to Nii): Et, 


too, is ignored, however, if at least one other component 


that exhibits failure has sample size equal to Ni): 





III. THE SIMULATION 


A. GENERAL METHODOLOGY 

A computer simulation is used in this study as an 
analytical tool for evaluating a proposed LCL procedure; the 
Method is as follows: 

ds Suppose it is desired to evaluate a proposed 
100(l-a)% LCL procedure, denoted R eeaya for system reli- 


ability Ro: Then the assertion is 


PIR < Rg] > Ia (351) 


s,L(a) 


Equality should hold if Re ) is a continuous random 


rula 
variable. 


2. R, = E (Py sPar-++1Py)s where Py is the true relia- 


bility of the component. For an independent series system, 


ce Assign values to the parameters a, k, ns and 


Par i=1,2,...,k. Perform ny Bernoulli trials for the ith 


component to get the number of successes/failures for each 


component and then compute the resultant R, wero 
, 


4, Generate the approximate distribution of Rs L(a) 
, 


by repating step 3 500 times. 


5. Order the R. 


Sta) realizations to get 


aa na 


R poszetapht : 
s,L(a) (1) s,L(a) (500) 


2a: 





6. Find the 500(l-a)th order statistic of R 
aa s,L(a) 


and denote it A . Thus A is the (l-«)th_ percentile 


l-a 1l-« 

of the distribution of the LCL random variable Ra eae 

[e By repeating steps 3 through 6 for various sets of 
K,Ny Nore ee Ny, Py rPores +1 Dy and comparing the resultant 
Aly to Re the overall performance of the LCL procedure can 
be evaluated. 

The actual confidence level given by Rats can be 
obtained by finding the order statistics of the generated 


distribution which matches (or is closest to matching) Ry: 


* 
If the index of this order statistic is denoted i, then 


_* 


35 x 100% = Actual level of confidence (3.2) 





a 


of Re Ue) 


Equivalently, if A < Roi the procedure is a conservative 


l-« 


one, and vice-versa. 


B. ACCURACY CRITERIA 


There are three characteristics of the distribution of 


a 


Re ula) for determining the accuracy of LCL procedure. 
They are: 

1 The mean 

oe The variance, and 

3% 


Alea" 


The variance should be small and the actual values should 


Still be within the ball park when the LCL is applied. 


22 








If an tact, R is an exact 100(1-«)% LCL procedure 


s,L(a) 
for Ry: that is 
PIR, n(g) < 8s! = 1-9 (3 <3) 
then Aly should be close to Rs regardless of the set of 


parameter values used and for each value of a. 


Thus the quantity’ 


Pag Phe (3.4) 


is a measure of the accuracy of the procedure. 


Cc. SIMULATION ALGORITHM 
Step 1. Given a set of parameters k, n; and Dar 
i = 1,2,...,k, generate binomial data as follows: 
For the ith component, i = 1,2,...,k, draw a uniformly 


distributed random number u from the interval [0,1] and 


compute the number of successes Xs 


‘ Le Dy 
Ss. = 


a, ‘ 
QO if u > Ps 
fs 
2 
x; = : Sir 1 = lee ye ways (243) 


All the procedures described in chapter II simply 
ignore the zero-failure component(s) with the result either 
the computed LCL tends to be very high or the procedures 


cannot be applied. 
For example if x,=n; for all i, then oF in equation 2.3 


is zero, and hence the ML's LCL in equation 2.4 is equal to 





one and the Easterling and Randomized Easterling procedures 


cannot be applied because n, the pseudo sample size in 


equation 2.32, is not defined. Likewise the Madansky proce- 
dure cannot be applied (equation 2.9 is not defined). [In 
this case the Log-Gamma's LCL and the Mann's LCL are close 

to one. To cope with this problem two methods of introducing 
partial component failures will be presented in this study 
for those methods which accommodate zero failures. 

FIRST METHOD. If x,=n; for all i, pick the component 
with the largest sample size or pick the first component if 
all sample sizes are equal and introduce a half failure to 
that component; this method was proposed by W. M. Woods. 

SECOND METHOD. Whenever £,=0, set £,=4/(n,k), this 
method was proposed by Lisowsky (Ref. 4). 

Step 2. For each a (a=0.1 and a*0.2) compute the LCL 
for all procedures as described in chapter II. 

Step 3. For each set of data repeat step 1 and step 2 
500 times, order the LCL's, and then compute Ayia?! mean, 
standard deviation of the LCL distribution, the actual level 
of confidence in equation 3.2, and the average failure per 
replica. 

Now determine each procedure's accuracy by comparing 
the Ai, 's with the true system reliability Ry and relative 
dispersion by comparing their mean and standard deviation. 


For detailed computation algorithm see Appendix, The 


Computer Program, 








IV. SIMULATION RESULTS AND CONCLUSIONS 


A. GENERAL DESCRIPTION 
The accuracy of the procedures are compared for a variety 


of sets of parameter values (k, p., n., i=1,2,...,k). These 


a 1 
different sets of parameters are called cases and are 
numbered. For each case the two methods of introducing 
partial component failures were applied at two different 
confidence levels: 90% and 80% CL. 

The simulation results were tabulated in Table II at 
the end of this chapter; for each case the results were 
listed in one table, for example Table II.1 for case number 
1, Table II.2 for case number 2, etc., up to Table I1I.36. 
The letter suffix attached to the case number denotes the 
method of introducing partial component failures. In 
particular case la means the FIRST METHOD of introducing 
partial component failures as described on page 24 was applied 
to case 1. Similarly case lb means the SECOND METHOD of 


introducing partial component failures as described on page 24 


was applied to case l. 


By varying nj while k and Pp; are held constant in each 


case, the sensitivity of the procedures can be examined. 


B. THE EFFECT OF SAMPLE SIZE 
Observing the simulation results in Table II starting 
from sample size 15 through 50 on each case, these results 


indicate that increasing sample size (continued on page 27 ) 
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Foar 


MN 


TABLE I 


NOMENCLATURE FOR SIMULATION RESULTS 


Number of series connected components 
Sample size of ith component 
True reliability of ith component 


True independent series system reliability, 


k 
R_ = I op, 
s j=1 1+ 
Sample mean of Re ula) 


Sample standard deviation of Re L(a) 


Average failure per replica 


500. “ie BE 
(17500). 2- 2. By 
1 i=lil 


Total number of FIRST METHOD of introducing 
partial component failures applied 


Total number of SECOND METHOD of introducing 
partial component failures applied 


100 (1l-a)% confidence level 

Actual confidence level, computed using equation 
3.2, page 22, the result is rounded to the 
smallest integer 

The 500(l-a)th order statistic of Re nla) 
Maximum likelihood method 

Madansky method 

Log-Gamma method 


Easterling method 


Randomized Easterling method 


Mann method 





causes the A a8 to converge to Roo thus decreasing the value 


1l- 


of jA,_,-R,| of all procedures, The results also indicate 
that some of the procedures need larger sample sizes to 
converge satisfactorily. 

With medium sample size (30) and large sample size (50) 
the performances of ML, MD and MN procedures are comparable, 
although at sample size 30 in some cases MD and MN procedures 
perform better than ML procedure as shown in case 5, 14 and 
23. But with sample size 15 and with R, > 0.900 the ML 
procedure seems to perform better than MD and MN procedures 
as shown in cases 1, 16 and 19. 

The LG, MML and RE procedures converge rather slowly, 
but RE tends to converge faster than MML in all cases; this 
is due to the randomization effect as described in chapter II 
section E page 19% On the other hand with unequal sample 
sizes (mix of large, medium and small sample sizes) these 
procedures tend to converge satisfactorily as shown in case 
34, 35 and 36, while the MN procedure always yields unsatis- 
factory results, and again ML and MD procedures are still 
comparable under this condition. Note that in these cases 
only the SECOND METHOD of introducing partial component 


failures can be applied in the MD procedure as was pointed 


out by Lisowsky (Ref. 4). 





Cc. THE EFFECT OF THE METHOD OF INTRODUCING PARTIAL 
COMPONENT FAILURES 


When the cases under study have large sample sizes if 
it can be expected that all components of these cases exhibit 
failure(s) or only a few components exhibit no failure, then 
the two methods practically have no effect on the computed 
LCL's as demonstrated by simulation results using sample 
sizes of 50 in Table II. These facts were also shown in cases 
where Pp, < 0.960 for all i with sample size 30, i.e., case 8, 
11 and 14, Table II. The explanation is as follows. Take 
as an example case 8a where Nfail = 2; this means that the 
FIRST METHOD of introducing partial component failures was 
applied twice. Its contribution to the average failure per 
replica (Fbar = 5.6) was very small: (2) (0.5) (1/500) = 
0.002. In case 8b Ncorr = 768, the SECOND METHOD was applied 
768 times and its contribution of failure to Fbar (5.7) was 
{ (768x4) /(5x30)}(1/508) = 0.04. Both of these contributions 
were small compared to Fbar so that the computed A,_.'s in 
case 8a and 8b were approximately the same. Note that the 
value of Fbar is rounded to the first decimal in Table II. 

On the other hand if n; is small and PB; is high for all 
i as in cases 1, 16 and 19, then different values of Adis 
can be expected from the two methods. For example case la, 
Nfail = 251 and the contribution of failure to Fbar (1.0) 
was: (251) (0.5) (1/500) = 0.25. In case 1b Neorr = 2171, 


its contribution to Fbhar (0.9) was { (21717x4)/(5x15)} (1/500) = 


0.23. Both of these contributions were quite high compared 





with Fbar and therefore the computed A «5 were different, 


1- 
except for MML and RE procedures which were due to the fact 
that n and x in chapter II section D and E on pages18 and 19 
rounded up to the next integer. In these cases the ML, MD 
and MN procedures yield higher and the LG procedure yields 


lower A a 5 with the SECOND METHOD, but this was not so for 


1+ 
the other cases. 

A more detailed quantitative analysis is needed to deter- 
mine the range of values of k, ny and Py For which the FIRS? 


METHOD is better than the SECOND METHOD for each procedure 


and vice versa. This is beyond the scope of this study. 


D. CONCLUSIONS AND REMARKS 

The overall performance of ML, MD and MN procedures are 
comparable although with medium sample size (thirty) MD and 
MN procedures perform better than the ML procedure, but with 
small sample size (fifteen) the ML procedure seems to perform 
better than MD and MN procedures. 

The LG, MML and RE procedures tend to yield satisfactory 
results using unequal sample sizes (mix of large, medium and 
small sample sizes), while the MN procedure always yields 
unsatisfactory results. The ML and MD procedures are still 
comparable under these conditions. 


The randomization technique was successful since RE 


procedure yielded better results than MML procedure. 





The ML procedure is simple and easy to implement, there- 
fore this procedure can also be used as a rough and ready 
method. The MD procedure requires a computer to work with 


while the MN procedure can be solved with a handheld calcula- 


tor although it is a rather complicated computation. 





TABLE II.1 
= TABULATED SIMULATION RESULTS 
Case la: k=5, Pp, =0.990, n,=15, 1217 253464 9% R,=0.951 


FIRST METHOD: Fbar = 1.0, Nfail = 251 


RRKKKKREGOT CLE KR RRKKERE RREKKKEKEQOOS CLERK RRRKKER 
A 90 m s ACL A 380 m s ACL 
ML .907 861 .060 50 -928 .887 .054 50 
MD ~872 .830 .056 50 ~912 .874 ~052 50 


LG 708 660 e053 50 .818 .776 049 50 


MML .778 734 053 50 824 «782 052 50 
RE 847 a ee .062 100 «873 ~oL8 .059 100 
MN £810 .777 .042 50 $855 eO29 041 50 


Case lb: same as la 


a SECOND METHOD: Fbar = 0.9, Ncorr = 2171 
ML .939 . 869 .079 50 .954 .893 .070 50 
: MD 901 .837 073 50 .938 .879 .067 50 
LG .652 S627 .020 82 .797 .766 .039 50 
MML .778 .728 .056 50 sea ee Be 054 50 
RE .847 . 768 .065 100 .873 .814 .061 100 


MN 885 829 .065 50 914 862 061 50 





TABLE II.2 (Continued) 


Case 2a: 
FIRST METHOD: Fbar = 1.6, Nfail = 121 


RKEKKKEKOOS Cle RK KKK 


A 99 m s ACL A 30 m 

ML e959 1699 4030 76 .964 7.955 
MD 934 882 .048 76 956 .908 
LG »842 ~7921 .036 76 905 2337 
MML .880 824 045 76 906 854 
RE .905 845 .048 100 913 «873 
MN 901 861 036 76 e925 887 
Case 2b: Same as 2a 


SECOND METHOD: Fbar = 1.6, Ncorr = 1844 


ML 980 ~902 .058 76 -985 s9L8 
MD Re foe ~885 2055 76 me «Fil 
LG 819 2197 029 76 A ae) 862 
MML 880 -823 .044 76 .906 ~853 
RE 905 .843 .048 100 ee eS .872 
MN ~948 .884 050 76 2962 .904 





Same as la, except n,=30, PSM 2 pescs¥D 


s0SL 
.050 
.040 
.042 


-045 


.046 


RREKRKEKERKOOS CLERK KKEKE 


ACL 


45 


76 


76 


76 


100 


76 


45 


5A 


76 


76 


100 


76 


TABLE II.3 (Continued) 


a 
Case 3a: Same as la, except n,=50, fal 2 fe eeced 
FIRST METHOD: Fbar = 2.5, Nfail = 49 
RKEKKKKKAOOS CLR KRKRKEE RKEKKKEEOOS CLR KRREREE 
A 90 m s ACL A 30 m s ACL 
ML <9.55 .915 040 68 963 928 .037 68 
MD .944 905 939 86 2959 .924 036 68 
LG 893 . 860 ~032 90 930 2896 2033 90 
MML .901 .868 .036 90 «920 - 889 .034 90 
RE 926 -880 938 98 2,931 900 -035 93 
MN «925 897 2031 90 941 ,9i4 .031 90 
Case 3b: Same as 3a 
ee SECOND METHOD: Fbhar = 2.5, Ncorr = 1529 
ML 4253 <a L6 043 68 <962 | .928 039 68 
2, MD 942 906 .042 72 i957 924 038 68 
LG «689 . 860 .030 90 927 897 .034 90 
MML .899 868 .036 90 <918 .888 .034 90 
RE 925 . 880 .037 98 -929 900 035 3 
MN ~941 908 038 73 2953 po24 036 68 





TABLE II.4 (Continued) 
+ 

Case 4a: k=5, p,=0.977, n,=15, tad os ep Be R,=0.890 
FIRST METHOD: Fbar = 1.8, Nfail = 84 

KHKKKKKKEKQOOS CLL RK KE KK KR KHKKEKKEKE GOS CLERK KERR RR 

A 90 m. Ss ACL A 80 m Ss ACL 
ML <907 . 786 .096 83 «879 soL9 .087 53 
MD eor2 .760 089 83 866 .808 .084 83 
LG e108 614 057 83 .780 aod .066 83 
MML 778 eOrd 076 83 .765 720 .074 83 
RE 818 .706 083 100 825 754 .080 On 
MN -810 2725 .069 83 313 ie tL .069 83 
Case 4b: Same as 4a 

st SECOND METHOD: Fbar = 1.9, Ncorr = 1754 

ML #939 . 780 103 83 2861 me = i .093 65 
MD 901 .754 .095 83 . 849 802 .090 53 
LG .652 -609 .044 81 159 Pa .064 83 
MML .778 665 074 83 Py eon 2716 O72 83 
RE . 818 e701 081 100 5815 Pee ge) .079 97 
MN 885 .754 089 83 -337 sf 9L .084 83 





TABLE II.5 (Continued) 


¥ Case 5a: Same as 4a, except n,=30, 1=1,2,...;5 
FIRST METHOD : Fbar = 3.5, Nfail = 10 
RRREKEKKKEOOS CLE RRRRKRREX KARKKEEKE OOS CLE RRKRRKKS 
A 90 m S ACL A 30 m S ACL 
ML «925 818 .068 75 Pee a 842 063 70 
MD 307 805 -065 87 . 890 - 836 .062 85 
LG 25 741 046 98 . 848 .796 .052 95 
MML .842 .754 .058 98 .834 787 .056 98 
RE ,853 Par Ae .061 98 -856 .805 .058 92 
MN Ord .799 .055 98. .877 826 .054 fps) 
Case 5b : Same as Sa 
a SECOND METHOD: Fbar = 3.6, Ncorr = 1217 
ML <aL9 . 816 .068 76 .893 .840 .063 70 
e MD 2902 «803 .065 87 887 834 .062 83 
LG 818 .744 .050 98 845 .797 .055 89 
MML .837 753 .057 98 834 787 .055 98 
RE .849 Zita .066 98 856 804 .057 33 


MN ~902 808 062 87 883 832 059 76 





TABLE II.6 (Continued) 


Case 6a: Same as 4a, except n,=50, 1=1,2,.+.,5 


FIRST METHOD: Fbar = 5.7, Nfail = 1 


RAEKKKKEKROOS CLERK KR RKEKKKK RRAEKKKKEREOOST CL kaka KKKKK 


A m s ACL A m™ s ACL 


.90 . 80 


“052 82 209k 856 .049 egtl 





MD 889 . 830 2051 91 . 887 852 .048 81 
LG 851 796 .045 98 864 831 .045 89 
MML .855 189 047 98 355 823 .045 92 
RE eB tz 809 048 he) 874 833 2045 89 
MN 890 832 047 87 . 886 850 .045 82 
Case 6b: Same as 6a 
ee SECOND METHOD: Fbhar = 5.7, Ncorr = 779 

ML 898 «oo 052 82 891, My obo ie) .049 79 
MD 889 829 050 90 O87 852 .048 79 
LG «891 .796 .045 98 . 864 . 830 .045 90 
MML .855 798 047 98 i853 «822 .045 92 
RE 872 809 047 95 .874 . 833 045 89 
MN soe 335 .049 82 . 886 3852 .047 81 





TABLE II.7 (Continued) 


. Case 7a: p,=0.961, n,=15, 11 245 eae R5=0.820 
FIRST METHOD: Fbar = 3.0, Nfail = 25 
RKEKEKKEREAOY CL eR RRR KKK REKKKKKKOOZ CLERK KKK 
A 90 m s ACL A 80 m s ACL 
ML ~851 .700 pa Ble} 79 «379 740 107 63 
MD . 820 -680 - 107 79 . 866 arak .104 78 
LG eos) vor0 067 95 42 -662 .082 95 
MML .716 -605 .088 95 765 .655 087 95 
RE 766 636 .094 o7 svi2 686 092 O21 
MN 765 -660 .088 95 «813 706 089 73 
Case 7b: Same as 7a 
* SECOND METHOD: Fbar = 3.1, Neorr = 1381 
ML :831 3092 sl 25 79 861 sae <b07 76 
+ MD: .802 2675 -106 82 849 .724 4103 79 
LG <o52 067 .065 2! Pat b=) 2657 .082 95 
MML .700 «601 .085 95 Papo «692 .084 95 
RE <hDS #033 -O91 97 5762 .683 .090 94 


MN Pe: (CE L027 203 84 oooe Pe a 2099 79 





TABLE II.8 (Continued) 


Case 8a: Same as 7a, except n,=30, for alli, Eel, 25 6.0¢5 


FIRST METHOD: Fbar = 5.6, Nfail = 2 


TKRAKRKKEGOS CLARKREKKEEK KHEKKKKEEKQOS CLL RRR KK KEKE 

A 90 m s ACL A 30 m s ACL 
ML 835 ~742 .078 83 +823 .771 .074 69 
MD »822 oboe 5075 84 818 . 766 .073 83 
LG .764 .683 2961 99 .784 .734 .065 89 
MML .772 639 .067 cal et lh .724 .066 o2: 
RE .801 . 706 -070 93 ~794 alt, .068 86 


MN 4824 734 070 87 e8L5 .762 .068 83 


Case 8b: Same as 8a 


SECOND METHOD: Fbar = 5.7, Ncorr = 768 


ML . 833 ~741 .078 83 «822 e109 .073 7k 
e MD . 820 73 075 88 <OL7 165 <O72 81 
LG 762 -684 .064 99 3783 734 .066 89 
MML .772 “689 067 a1. Par ie a ~724 7065 91 
RE . 800 . 706 «069 94 o1o4 .740 067 86 


MN 1825 .738 20:73 83 . 816 ~765 «070 82 





TABLE II.9 (Continued) 


Case 9a: Same as 7a except n,=50 for all i, i=1,2,...,5. 


FIRST METHOD: Fbar = 9.6 Nfail = 0 


RAEKKKKKEKKOOQS CL eR RK KKK REEKKKEKOOQS CLERK RRR RRKE 

A 90 m s ACL A gy m s ACL 
ML 2829 ~fod 060 84 a Pan IT9 Oar 76 
MD 821 s7oL .058 85 ~824 a ie ae KQST 76 
LG .790 2725 .054 95 -804 <729 .054 84 
MML .792 ~726 .054 95 .796 752 J0S3 87 
RE 808 736 2055 a2 803 .762 .054 86 
MN . 826 «tot <057 85 .824 ~118 03.5 76 


Case 9b: Same as 9a 


SECOND METHOD: Fbar = 9.6, Ncorr = 376 


ML .828 ma oe .060 84 <B2T efT9 «O57 76 
« MD . 820 ee .058 87 .824 eed £057 76 
LG .790 .724 .054 96 .804 si? .054 84 
MML .792 <1Z0 .054 a3 .796 uf32 .053 87 
RE .808 «4 36 .055 a2 803 4762 .054 86 


MN e327 158 2057 84 .825 et To .056 76 





TABLE II.10 (Continued) 


Case 10a: k=5, p,=0.950, n,=15, Lal 2p eecyoe R,=0.774 


FIRST METHOD: Fbar = 3.7, Nfail = 14 


s KREKKKKKEDOS CLERK RKKEKE RREKKKKEESOS CLERK KKKEKE 
A 90 m .s ACL A 30 m Ss ACL 

ML 2851 650 123 76 739 693 2h LG 72 

MD 820 -634 114 88 789 680 He F2 

LG 631 542 O77 97 oer col .626 .O91 95 

MML .716 -567 .094 97 .699 .618 .094 89 

RE 723 597 099 95 727 647 098 90 

MN < 165 -621 .099 89 2165 -667 .100 76 


Case 10b: Same as 10a 


SECOND METHOD: Fbar = 3.8, Ncorr = 1145 





ML ee .643 Pete e 86 788 .687 .114 72 
i! MD ~802 .628 eil2 89 .778 - 680 gL L Tas: 
LG ,OL9 2998 .076 96 .704 -621 -O91 93 
MML .700 3005 .091 a7 «699 .616 .092 89 
RE Pa w= 2595 e037 96 ~724 ~645 .096 90 
MN Sook 2633 LO 89 «FQ -674 «LO7 72 
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TABLE II.11 (Continued) 


Case lla: Same as 10a, except n,=30, i=1,2,...5. 


FIRST METHOD: Fbar = 7.6, Nfail = 0 


; KKKKKKEKKOOS CLRRKKKKKK KK KKKKKKEKQOZD CLL RKKKKKKKKE 
A 99 m s ACL A 30 m s ACL 

ML .794 -681 084 83 787 e712 ~O81 76 

MD .782 .673 .O81 88 «33 .708 .080 76 

LG 2129 «633 2071. 98 ~ 750 -681 .074 88 

MML .737 636 073 96 738 67-2 O72 89 

RE ~742 «652 rate) 95 ~745 -687 -074 89 

MN Pel card .078 88 .778 707 .076 77 


Case lib: Same as lla 


SECOND METHOD: Fbar = 7.6, Ncorr = 551 


ML eto .680 .084 86 . 786 ey oe | 081 76 
« MD bbe .672 -081 88 ~781 @ fOF 6079 76 
LG ~726 -632 .O71 98 - 748 .680 .073 88 
MML .737 .636 .072 96 738 “o72 O72 89 
RE ~742 <652 .075 95 2745 O87 .074 89 
MN . 786 680 -9080 88 7S. 708 .078 76 
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TABLE II.12 (Continued) 


Case 12a: Same as 10a, except n,=50, i=1,2,...,5. 


FIRST METHOD: Fbhar = 12.5, Nfail = 0 


REKEKEREQOS CL ¥ RR KK REKE REEKKEKKEQOS CLERK RRR KRKE 


A 90 m s ACL A 30 ™ s ACL 
ML «789 . 703 .061 89 Par ar0| ged. ~<039 81 
MD .778 698 060 89 768 725 .059 81 
LG ~730 -676 056 97 750 <fi0 .056 89 
MML .750 -676 056 25 e145 704 ~055 89 
RE .754 686 056 55 760 yples: .056 86 
MN - 782 706 .058 89 770 5,728 .057 81 
Case 12b: Same as 12a 

SECOND METHOD: Fbhar = 12.5, Ncorr = 187 

ML -784 s193 £061 89 «770 727 +099 81 
MD .778 689 .059 89 .768 725 .058 81 
LG .749 .675 .056 7 .750 .709 .056 89 
MML .750 .676 -056 95 2745 .704 <055 89 
RE -754 686 .056 95 . 760 ay pe «056 86 
MN vis .706 2059 89 .770 728 .058 81 





TABLE II.13 (Continued) 


Case l3a: k-5, p,=0.947, N,=15, Lal pes pos R,=0.762 


FIRST METHOD: Fbar = 3.9, Nfail = 7 


KKKRKEEKKOOS CLERK RR KK AREER RREKKKEKEQOS CLERK RREKKE 
A 90 m Ss ACL A 30 m s ACL 

ML ~762 .641 120 rae 2799 -684 -114 63 

MD .738 .626 cob ed 89 .789 so77 «Lt LO 74 

LG O27 <235 075 98 Per 90 2619 .089 97 

MML .648 <a ook 98 8699 2610 092 91 

RE .714 590 ood 96 ~129 .640 096 89 

MN tee .614 .098 o1 e465 -660 .098 77 


Case 13b: Same as 13a 


SECOND METHOD: Fbhar = 4.0, Necorr =1122 


ML 750 .634 aly 87 st o8 sO77 sits 74 
< MD vel /819 -108 89 ae) <O7 eb07 74 
LG -617 .233 .076 95 -704 -614 .089 93 
MML .648 so07 089 98 699 -608 -089 91 
RE wile, .588 .094 98 «20 -638 .094 92 
MN Pee .624 106 79 .770 -665 .104 75 


43 





TABLE II.14 (Continued) 


Case l4a: 
FIRST METHOD: Fbhar = 8.0, Nfail = 0 


KRKKRKKKOOY CLARKKKKKKER 


A 90 m s ACL A 80 m 

ML .794 668 085 88 2785 700 
MD siee -661 .O8l 88 780 097 
LG ered ¢623 O72 96 -748 -671 
MML .737 -626 073 96 738 x661 
RE 743 641 075 94 -743 -677 
MN i T6 666 078 88 Pe bv 696 
Case 14b: Same as l4a 


SECOND METHOD: Fbar = 8.0, Ncorr = 493 


ML Pe 5: Bl .668 .084 88 -782 3699 
MD ey @ oe 660 ~O8l 88 ere -696 
LG ct26 e622 5072 98 ~745 -670 
MML .737 620 073 96 </38 -661 
RE 743 ~641 2075 94 743 <o77 
MN 206 .668 .080 88 sree .697 
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Same as 13a, except n,=30, BELG 2 possi: g Die 


s 


.O8l 
-980 
.074 
wO72 
.074 


.078 


REKKKKKEEOOS CLE*RRRKKERE 


ACL 


78 
7% 
88 
89 
86 
79 


78 
77 
88 
89 
86 


78 





TABLE II.15 (Continued) 


Case 15a: Same as 13a, except n,=50, i=1,2,...,5. 


FIRST MEVYHOD: Fbhar = 13.2, Nfail = 0 


KREKKKEKOOZT CLARK AKKKEKE REKKKEKKKOOD CLERK RKKKEKE 


A 90 m s ACL A 30 m s ACL 
ML . 766 -690 060 85 768 «715 .059 77 
MD . 760 -685 “059 92 «166 TL 058 77 
LG tos -664 055 7 749 ~697 056 85 
MML .734 665 055 97 otek 692 .054 86 
RE .743 .674 .056 95 ~745 2701 -055 85 
MN 767 693 .058 86 768 «715 .057 77 
Case 15b: Same as 15a 
SECOND METHOD: Fbar =13.2, Ncorr = 
ML 766 -690 .060 85 .768 ag eles, 059 a 
MD . 760 -685 mache) 92 . 766 i213 <058 TI 
LG re ee | 3663 7055 97 .748 <697 .056 85 
MML 734 ~665 «055 97 a 8 .652 .054 86 
RE 743 .674 <056 gS 745 -701 055 85 
MN s707 .694 .058 85 . 768 .716 .057 ae 








TABLE II.16 (Continued) 


Case 16a: k=15, p,=0.995, n,=5, es Lido aie ips Ri=0.928 


FIRST METHOD: Fbar = 1.3, Nfail = 157 


REKKKKKEOOQS CLE RKKEKE RREEKKKEKEQOOS 

A 90 m s ACL A 30 m 
ML 907 ook .078 68 ~928 . 860 
MD 872 .801 .072 68 -912 847 
LG 708 -632 -057 68 818 748 
MML 778 707 .064 68 824 736 
RE . 839 <fS5 -072 100 850 wt OZ 
MN . 810 <t50 053 68 7305 “803 


Case l6b: Same as l6a 


SECOND METHOD: Fbar = 1.4, Ncorr = 6952 


ML «239 goer .094 68 954 . 856 
MD rege «198 sU87 68 938 843 
LG 646 -620 030 68 «197 .744 
MML .778 ~701 .064 68 824 «290 
RE 839 ~ 740 .072 100 850 S17 
MN .895 .804 .079 68 «220 836 
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CL ERR KRKKKEKE 
s ACL 
eO7L 68 
.068 68 
.058 68 
.063 68 
-069 100 
.053 68 
084 68 
.081 68 
2052 68 
.063 68 
.069 100 
074 68 





TABLE II.17 (Continued) 


Case l7a: Same as l6éa, except n,=30, i=l,2,...,15 


FIRST METHOD: Fbar = 2.3, Nfail = 37 


RRKKEKKKEEQOE CLL¥RRRKEKKKEEK REKRKKKKKOOS CL** RR KK RKKE 


A 90 m s ACL A 30 m s ACL 
ML Evo 867 .058 68 e239 887 053 68 
MD .907 “BoZ -055 92 2932 - 880 .052 68 
LG .796 ~764 s035 92 861 . 830 -042 92 
MM .842 3196 .049 92 seTL . 828 .047 92 
RE . 880 .816 »052 100 889 . 846 .050 97 
MN sold 840 .043 92 .904 865 .042 92 
Case 176: Same as 17a 


‘ SECOND METHOD: Fbar = 2.4, Ncorr = 6426 


ML 918 865 061 76 2933 884 .055 68 
MD 202 820 5038 81 ~926 878 .054 87 
LG 816 tlt 039 92 .877 <335 .046 92 
MML .837 <795 .048 22 867 826 .046 22 
RE 876 e815 .O51 100 - 886 845 .049 97 
MN ~906 “oo7 .054 76 <723 .878 .O51 76 





TABLE II.18 (Continued) 


Case 18a: Same as 16a, except n,=50, 1=1,2,...,50 


FIRST METHOD: Fbhar = 3.8, Nfail = 18 


REKKKKKEAOS CLARK RKKS REKKKKKEEGOS CLERK RRR 

A 90 m s ACL A 30 m s ACL 
ML 955 383 046 74 337 898 043 73 
MD 944 .874 .045 88 933 894 .042 73 
LG 893 832 037 96 899 868 039 88 
MML .901 840 .042 96 896 862 039 88 
RE 904 851 043 96 -909 <873 040 ou 
MN 25 873 £038 88 2925 . 890 037 74 
Case 18b: Same as 18a 
SECOND METHOD: Fbar = 3.8, Ncorr = 5851 
ML 952 882 .048 79 «936 897 .044 13 
MD saad <873 046 88 293k <o73 .043 73 
LG 888 . 834 038 96 .904 869 .040 95 
MML .899 332 .041 96 . 896 .862 039 88 
RE «902 ~85L 043 96 909 Pa i .040 91 
MN ~944 . 880 .043 83 SA 895 041 73 
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TABLE II.19 (Continued) 


Case 19a: k=10, p,=0.990, n,=15, eds pads 70's R=0.904 
FIRST METHOD: Fbar = 1.6, Nfail = 110 


se RRKKEKEKEAOOS CL¥ RRR RRKKEK REKKKKEEKOOS Che KR RKKKKKKK 


A s ACL A m s ACL 


ML 207 801 .090 78 «928 .833 082 78 


MD .872 ott & .983 78 re -821 .079 78 
LG .708 .618 -056 78 2-818 ~teo .063 78 
MML .778 .684 e072 78 824 3733 .070 78 
RE .820 eo 079 100 #3833 - 766 .076 100 


MN -810 736 .062 78 <300 ~782 .062 78 


Case 19b: Same as 19a 


- SECOND METHOD: Fbar = 1.8, Ncorr = 4289 


ML 2939 .794 ~LO2 78 ~954 - 826 O91 72 
. MD ~901 . 768 .094 78 ae Slo .088 78 
LG .648 -611 037 88 nat oe 061 78 
MML .778 .678 S07L 78 824 ya: .069 78 


RE - 820 ~714 .078 100 833 uhO2 .075 100 


MN «B92 Pa oe .087 78 e219 808 .082 78 
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TABLE II.20 (Continued) 


Case 20a: Same as 19a, except N,=30, t=1,2,%< «710 


FIRST METHOD: Fbar = 3.0, Nfail = 23 


- KEKKEKEEKGOR CLARK KERR KEKEKKEKEOOS CLL RRR AKKE 
A 90 ™m s ACL A 30 m s ACL 

ML «925 .839 .066 81 897 861 -061 59 

MD .907 {o25 .064 81 . 890 ~o55 .060 80 

LG . 796 Pigs pe .043 95 849 811 .050 95 

MML .842 re ~057 a5 834 -805 .054 95 

RE 869 wi od .059 98 . 868 »822 .056 93 

MN «877? .818 4.053 95 .877 844 2052 81 


Case 20b: Same as 20a 


ss SECOND METHOD: Fbar = 3.1, Ncorr = 3703 


ML 919 ~8o7 068 81 ~892 859 -062 78 
» MD =901 3823 065 83 - 886 “855 .061 81 
LG . 816 ae Et) .048 95 844 2013 .054 9:5 
MML .837 gf be 056 i 834 804 -054 95 
RE 865 .790 2038 98 - 868 Bed 055 94 


MN so ~ook 062 8l - .885 2Bo3 -958 81 





TABLE II.21 (Continued) 


Case 2la: Same as 19a, except n,=50, i=1,2,...,10 


FIRST METHOD: Fbar = 5.0, Nfail = 5 


; KHKKKKEKOOS CLAKRKKKKK KK KREKKEKEKYOY CLL RRKKKAKKKER 
A 90 m s ACL A 30 m s ACL 

ML sono 853 .048 80 ~9k3 .870 .044 76 

MD woL5 844 .046 89 .909 867 .044 76 

LG 856 809 .039 99 .880 843 .040 94 

MML .876 s8i2 .043 96 874 . 836 .041 89 

RE 879 .823 044 97 881 . 846 -042 91 

MN «910 847 .042 89 .902 3865 .040 80 


Case 21b: Same as 2la 


SECOND METHOD: Fbar = 5.1, Ncorr = 3019 


ML w23 852 -048 86 re be 869 ~045 76 
2 MD 2913 843 ~047 89 -907 . 866 .044 76 
LG . 869 . 809 .040 99 883 843 .041 89 
MML .876 ~812 043 96 .874 - 836 -O041 89 
RE e879 ~oa3 .044 27 881 846 .042 OL 


MN s218 ~851 .045 86 ~908 - 868 042 76 





TABLE II.22 (Continued) 


- Case 22a: k=15, p,=0.990, Pale 2 ace Gey P4570 .995; n,=15, 
sO bee aranergaares Ao Ye R,=9.864 


FIRST METHOD: Fbar = 2.3, Nfail = 62 


KREKEKKEKEREDOS CLeeK RK KAKK REKKKKEKOOS CLERK REKKEEE 

A 90 m Ss ACL A 30 m s ACL 
ML 907 e155 240 62 879 of 9d 102 62 
MD ,o72 ~732 -102 87 - 866 ~ 781 -098 62 
LG .708 589 061 87 742 695 «O76 87 
MML .778 648 -085 87 765 -698 084 87 
RE 796 683 .093 99 ~815 wPods 090 94 
MN -810 .704 980 87 813 749 .080 87 


Case 22b: Same as 22a 


SECOND METHOD: Fbar = 2.4, Ncorr = 6499 


« ML 939 744 ELS 76 859 27 BL 106 76 
MD 901, ei az LOFT 87 - 846 el ee 2L03 78 
LG 646 590 ~000 90 ~799 2692 -077 87 
MML .778 -643 083 87 Pa 2693 -082 87 
RE 796 -678 gOS 99 .805 eled .089 94 


MN ~895 “Se .102 87 ~841 .768 .097 74 





TABLE II.23 (Continued) 


Case 23a: Same as 22a, except n,=30, £152 aie ey ko 


FIRST METHOD: Fbar =4.3, Nfail = 6 


RREKKKEEOOS CL * RK RKKKRE REKKKEKEOOD CL RRR KKKKKEE 

A 90 ™ s ACL A 80 ™ s ACL 
ML Pes 193 -072 78 897 818 .067 66 
MD 862 -781 069 92 . 890 «813 066 78 
LG ~772 .719 -050 99 ~837 ~774 .056 92 
MML .803 ios 061 99 . 834 OT .059 92 
RE 835 ef SL .064 95 «839 784 .062 90 
MN . 853 780 .060 79 877 807 059 78 


Case 23b: Same as 23a 


SECOND METHOD: Fbar = 4.3, Ncorr = 5644 


ML 2872 2739 072 78 892 2oi5 -067 76 
2 MD eoo7 tit 3069 92 - 886 -810 066 76 
LG «789 wiles .056 99 842 145 059 92 
MML .803 ai30 O61 99 834 «767 5039 92 
RE «833 £751 .064 96 «839 -784 .062 90 
MN 865 .789 .067 79 . 886 «8l2 -064 76 
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TABLE II.24 (Continued) 


Case 24a: Same as 22a, except n,=50, i=1,2, 
FIRST METHOD: Fbar = 7.3, Nfail = 0 
RREKKEEKKOODS CLL**e RR REE REKKKKKEOOS 
A 90 m s ACL A 80 m 
ML 375 805 <053 85 869 825 
MD - 866 ~797 052 85 -865 ~822 
LG . 830 ~107 .046 99 843 «Ol 
MML .832 769 048 94 834 .794 
RE 848 780 049 94 - 843 .805 
MN . 869 804 .049 85 865 823 
Case 24b: Same as 24a 
SECOND METHOD: Fbar = 7.3, Ncorr = 4628 
ML s373 804 m6 bo Be 85 868 -824 
MD 864 e195 «052 92 864 ~321 
LG «829 767 047 98 842 «801 
MML .832 .769 .048 98 . 834 .794 
RE . 848 . 780 049 94 843 804 
MN 873 +807 .050 85 867 825 





veep be 

CLA RRR ERK REE 
s ACL 
050 75 
.050 76 
047 90 
046 85 
047 88 
.047 a 
.050 75 
4050 81 
047 92 
046 ao 
.047 88 
.048 75 


TABLE II.25 


Case 25a: 
FIRST METHOD: Fbhar = 2.3, Nfail 


RRKKKKKEEDGOS CLERK KR RKKKEE 


A 90 ™ s ACL 
ML ~851 paone .103 65 
MD . 820 «128 095 91. 
LG -681 wORT .054 oF 
MML .716 645 .078 em 
RE 783 678 .084 99 
MN ef05 702 .073 9%: 
Case 25b: Same as 25a 


SECOND METHOD: 


ML .828 stag 107 81 
MD 2799 .716 099 91. 
LG .646 ~990 .052 92 
MMI 6.700 .640 .076 oi 
RE re ae .674 .082 99 
MN 808 2s .094 = 


55 


= 46 


Fbhar = 2.5, Ncorr = 


Pasko] 
846 
i122 
Py gay 
eta 


84) 


(Continued) 


k=15, p,=0.990, Nj=15, i=l,2,..., 


6460 


.776 
766 


.689 


he 


.098 
.095 
«O71 
.075 
.080 


«090 


R_=0.860 
Ss 


KRKKKKEKKEEKOOS CLK RKKK EKER 


ACL 


65 
65 
94 
91 
95 


91 


81 
80 
91 
21 
95 


75 





TABLE II.26 (Continued) 


- Case 26a: Same as 25a, except n,=30, f=] 52 fice Lo 


FIRST METHOD: Fbar = 4.5, Nfail = 6 


HKKKKKEKGOS CLLRARKKHKEE KHEKKEKEKQGOS CL ERKKRKKEKE 

A 90 m s ACL A go m s ACL 
ML .877 .785 OT? 81 .858 .810 e0-72 67 
MD 862 sive .074 82 <O23 805 -070 | 80 
LG ot?2 otis .054 99 615 .767 .061 93 
MML .803 726 065 93 805 760 -063 93 
RE vO32 744 .067 96 835 ela dt .065 89 
MN 853 <1T3 .065 82 846 . 800 .064 81 


Case 26b: Same as 25a 


: SECOND METHOD: Fbhar = 4.6, Ncorr = 5591 


ME  .872 .781 .077 81 855  .807  .072 78 
i MD .857  .770 .073.~ 87 $949. «802. .<070: 79 
LG .789 .716 .060 99 .81l1 .768 .063 93 
MML .803  .726 .065 99 .805  .760 .063 93 
RE .832 .744 .067 96 6835 .777  .065 89 


MN 865 otek ,O71L 81 cook - 805 .068 78 





TABLE II.27 (Continued) 


Case 27a: 


FIRST METHOD: Fbar = 7.4, Nfail = l 


RHKKKKEROAQSE CI, RR RKKKKRE REKKKEEEKOOS 


A 90 ™m s ACL A 30 ™m 

ML 875 802 .057 80 869 «822 
MD . 866 795 055 86 865 819 
LG 23 765 .049 98 844 729 
MML .832 767 ~O51 94 834 ioe 
RE -841 778 .052 95 - 846 802 
MN . 869 802 7052 86 865 821 
Case 27b: Same as 27a 

SECOND METHOD: Fbar = 7.5, Ncorr = 4577 

ML ae 2801 -056 86 - 868 62k 
MD 864 ~794 055 86 864 .818 
LG 829 .765 .050 98 842 e199 
MML 832 etbd .O51 94 834 e792 
RE ~841 ettd 052 95 . 846 802 
MN $873 805 .054 86 867 <o22 





Same as 25a, except n,=50, i-1,2,.. 


spo 


CL eR RKKRKRER 


.054 
235 
.050 
050 
050 


.052 


ACL 


74 
74 
86 
86 
89 


74 


74 
74 
86 
86 
89 


74 


TABLE II.28 (Continued) 


Case 28a: k=15, p,=0.995, i=1,2,-..+,14, P 570-850, n,=15, 
a1 2 pew ag bos Ri=0.792 
- FIRST METHOD: Fbar = 3.2, Nfail = 16 


RRKKKKKEEAOOS CLL ee RK KKKEE RERKKKKEKKOOS CLLR KKRKKEE 


A 99 m Ss ACL A 30 m s ACL 

ML ~851 .678 124 72 marek) ote 116 63 
MD 820 <3.29 who 82 789 Peay gated 7 bie 82 
LG -681 «263 .O081 97 ot Lo. .648 093 87 
MML .716 1585 098 97 <699 «036 me 82 
RE eat a= Fe) 618 eB 0 ee 7 ~fo7 -668 2102 88 
MN Rago 2639 . 100 97 765 ~683 . L00 82 
Case 28b: Same as 28a 


SECOND METHOD: Fbhar = 3.4, Ncorr = 6548 


. ML 828 .664 gies 82 .783 e107 Lb 76 
MD <f99 ~647 rl A 82 a at 699 »LL2 78 
LG ~641 548 .072 98 -698 -635 -088 97 
MML 700 .578 096 oy 699 629 .096 a7 
RE e139 #611: -102 97 .750 -662 -101 90 
MN . 808 663 «Lid 82 Pes ay a ~701 -107 76 





TABLE II.29 (Continued) 


Case 29a: Same as 28a, except n,=30, Lal 2 p%057h0 


FIRST METHOD: Fbar = 6.6, Nfail = l 


* RREERKEKEQOS CLEKREKERERE RREKKEEEG OS CL RRR KKRKKEEK 


A 90 m s ACL A 30 m s ACL 
ML 796 -702 081 83 «790 2733 .078 80 
MD 783 693 .078 91 785 729 -076 80 
LG ~731 soon .067 98 ~754 .701 .069 91 
MML .737 653 071 98 745 689 .070 92 
RE a76L .670 me oe se | 96 768 705 .O71 89 


MN .784 .694 .073 32 seo ~724 Or2 80 


Case 29b: Same as 29a 


SECOND METHOD: Fbar = 6.7, Necorr = 5985 


ML ei92 699 -O81 90 Pi) «130 O77 80 
> MD . 780 .690 078 ce 2133 S726 .076 80 
LG 726 .648 066 99 750 -698 069 92 
MMU 6737 1692 OL 98 ~745 -688 .070 g2 
RE «761 2069 sO%2 96 - 766 e705 <O7 1 89 
MN ato 706 076 89 . 786 .732 -074 80 





TABLE II.30 (Continued) 


Case 30a: Same as 28a, except n,=50, Pel goes lS 


FIRST METHOD: Fbar = 10.9, Nfail = 0 


7 KRRKKKEKKEDQOS CLF RRR RRR RREKRKEKEKOOS CL * RRR KR EREE 
A 90 m s ACL A 30 m s ACL 

ML . 803 e123 061 87 . 800 747 «059 78 

MD .796 .718 059 88 ae -745 .058 78 

LG 766 “695 .054 98 wh tt 729 .054 87 

MML .766 {693 056 97 768 wt ZL <055 89 

RE ~774 .703 .057 95 2775 hook -056 87 

MN - 800 .724 <057 88 4793 746 -056 79 


Case 30b: Same as 30a 


SECOND METHOD: Fbar = 11.0, Ncorr = 5499 


ML 80.2 Tee 061 87 ~798 . 746 .058 78 
s MD 7195 er NG s059 89 ~ 196 ~744 058 78 
LG .764 .694 .054 98 -778 elee .054 87 
MML .766 “69:3 .056 97 . 768 .720 055 89 
RE eftis 103 <057 25 5775 ~130 ~056 87 


MN 807 ~731 958 87 801 ei DL 056 78 





TABLE II.31 (Continued) 


Case 3la: k=13, R=0.723 
Pj? 2995 <985°..979° .988 982 .980. 7967 7995. 2970 
5995-4968: 4980) ..900 
n,=15, Se) 2j 25 eps s 

FIRST METHOD: Fbar = 4.5, Nfail = 5 

KERKKKKKGOL CLL KRKKKK KEKE KRKEKKKEKGOZ CLLRRRKKKKAEK 

A 90 m s ACL AU 80 m s ACL 
ML «764 602 p23 84 73 .647 Lis 68 
MD 3735 589 -114 84 123. 641 114 84 
LG 598 «510 081 99 -663 588 095 89 
MML .648 sooL .094 23 655 581 095 84 
RE -685 560 -098 94 -690 .610 -098 88 
MN Re ae - 983 102 86 709 -628 «103 84 
Case 31b: Same as 3la 
SECOND METHOD: Fbar = 4.7, Ncorr = 4779 
ML .745 oo 120 84 EES 2637 cus aL 
MD e123 so79 ebe a2 ea del, 2031 ot LL 74 
LG 5607 002 080 99 -648 «o19 ,09°3 93 
MML .648 .526 .094 93 ~655 oe <095 86 
RE 685 5955 .098 95 -689 .605 .099 88 
MN e1a0 993 tO 84 ay eon 633 .108 wie 





TABLE II.32 (Continued) 


Case 32a: Same as 3la, except n,=30, Leb, 2 3s s-6 13 


FIRST METHOD: Fbar = 9.3, Nfail = 0 


KEKKKKKEGOZL CLLAKKKKKKEE KHRKKKKEKQOOS CLERKKKKKKKR 

A 90 m s ACL A 380 m s ACL 
ML .728 <O3t 080 85 stad .663 -078 75 
MD 718 625 077 90 ses 661 077 82 
LG 675 -590 069 96 695 637 072 88 
MML .678 ~594 .069 96 -682 630 069 86 
‘RE ~701 «609 e072 23 .704 .644 -O71 86 
MN ny £4) “633 .075 87 a fZa 663 .074 72 


Case 32b: Same as 32a 


SECOND METHOD: Fbar = 9.4, Ncorr = 3673 


ML w120 -629 .980 87 ~724 661 .077 78 
2 MD 716 2625 sO77 90 etek <659 .076 84 
LG «672 988 .069 OF ~692 <635 -O71 90 
MML .678 293 069 96 «682 -629 069 86 
‘RE OL .608 O71 93 .704 .644 “O71 86 


MN 2729 -637 .076 85 wt25 .665 <075 76 





TABLE II.33 (Continued) 


Case 33a: Same as 31a,except n,=50, i=1,2,...,13 


FIRST METHOD: Fbhar = 15.6, Nfail = 0 


RRKKKEKKKKEEOOS CLERK KEKE RHKKKKEROOS CLERK KKK 


A 90 m s ACL A 30 m s ACL 
ML gree 652 063 84 w123 678 -061 rei 
MD .724 648 061 87 731 676 061 77 
LG 700 .628 058 95 714 662 .058 84 
MML .699 630 057 93 £07 .658 .057 84 
RE «FLO 7639 .058 93 «716 667 ,057 82 
MN e133 .659 .060 84 734 681 059 77 
Case 33b:: Same as 33a 

an SECOND METHOD: Fbar = 15.6, Ncorr = 2752 

ML 2129 652 .063 84 «732 677 .0O61 rai 
MD .723 -648 -061 90 . 730 676 -O61 77 
LG .699 .628 .058 95 ~713 661 .058 84 
MML .699 630 2057 93 .707 -658 e057 84 
RE .709 639 058 93 e716 666 «057 82 
MN i735. 660 061 84 . 736 682 .060 ve 





TABLE II.34 (Continued) 


ey Case 34a: k=13. R,=0.723 
P, : .995 .985 .979 .988 .982 .980 .967 .995 
.970 .995 .968 .980 .900 
n.: 150 90 75 100 125 18 28 125 
63 125 59 5 19 


FIRST METHOD: Fbar = 15.5, Nfail = 0 


REEKKKKKOOST CL KKEKKKKEKK RKKKKEKKOOS CLERK KKKKRKKKER 


A 90 ™ s ACL A 30 m s ACL 

ML .749  .621 110 8l .740 .656 .101 72 

MD = = ~ 7 = = = = 

LG 721 .594 .108 91 724 .641 .099 80 
; MML .721 .594 .109 90 .716 .631 .102 81 

RE .737  .611 104 86 733.647. + =+.097 a4 
. MN .491 .404 .065 100 .549 .484 .070 100 
‘ 

Case 34b: Same as 34a 

SECOND METHOD: Fbar = 15.6, Ncorr = 2425 

ML .723  .603  .102 90 .720 .640 .095 80 

MD .656 .559 .086 99 .699 .624 .089 88 

LG .683 .570 .097 97. .700 .624 .091 87 

ML .685 .571 .098 97 .687 .611 .094 91 
: RE .703 .590 .095 94 .708 .630 .090 85 


MN «93 ~453 .078 100 .594 ree 080 100 





TABLE II.35 (Continued) 


Case 35a: k=15. R,=0.860 
Pp: .990 .990 .990 .990 .990 .990 .990 .990 
.990. <990 .990 ..990°-.990 °.990 990 
mas 250 40 120 15 130 65 70 75 
100 90 60 60 20 30 40 


FIRST METHOD: Fbar = 11.6, Nfail = 0 


KEKKEKEKOOLT CLERK KEKE KEKKKKEKQGOZE CLL RRRKKKKKKR 
A 90 m s ACL A 30 m s ACL 
ML soon . 803 .064 80 874 «823 «059 72 
MD _ ~ - - - - - in 
LG 861 776 067 89 862 809 060 79 
MML .862 778 068 89 -856 -802 .062 82 
; RE 870 788 066 86 » 863 OZ .060 78 
i MN .780 .720 049 100 803 Pa & 219 .048 99 


Case 35b:: Same as 35a 


SECOND METHOD: Fbar = 11.6, Neorr = 3881 


ML .876 800 .063 82 .870 4820 .058 73 
MD ~855 784 .060 = al -865 sono .057 76 
LG .854 .772 -065 92 .857 .806 .058 81 
MML .856 .774 .066 91 +853 «199 .061 83 


RE 864 ~785 .064 88 859 809 .059 80 





TABLE IL.36 (Concluded) 


Case 36a: k=15. Ri=0.792 
Py 995. 4995--,995-.995,-.995 .995,..995° .995 
<995° 4995. .995- 7995" .995 «993 2350 
n2:: 20 20 20 20 20 20 20 20 
20 20 20 20 20 20 150 


FIRST METHOD:: Fbhar = 23.9, Nfail = 0 


KKKKEREEGQE CLLAKKRKRRK KE KAA KAEAKEAQOY CLLR RRR Re 
A 90 m s ACL A 80 ™m s ACL 
ML 824 Pa ,O72 78 .808 .754 066 71 
MD - - - - - - - - 
LG .814 714 075 81 803 744 067 75 
MML .812 113 O72 Ss 81 798 tal 068 ra 
le RE .816 721 2072 81 804 ef43 066 75 
MN me BE 677 048 99 7 ESR i 713 .049 96 


Case 36b:: Same as 36a 


SECOND METHOD: Fbar = 24.3, Ncorr = 6296 

ML .802 sf LL .069 86 Pay i 8 eiao .064 80 
MD 788 e697. #2067 91 £735 sio0 .063 81 
LG .790 +692 O71 88 -781 .724 .064 84 
ML .789 e691 .O71 88 sh T6 eis 066 84 
RE .794 gfOL 069 88 .785 st28 .064 83 


. MN 749 .676 .058 97 iad .709 .957 93 





° APPENDIX 


THE COMPUTER PROGRAM 


The computer program consists of two main programs and 
five subroutines. The two main programs are basically the 
same. The first main program is used with the FIRST METHOD 
of introducing partial component failureSand the second main 
program is used with the SECOND METHOD of introducing partial 
component failures. The main program reads the input (case) 


k, n. Pio i=1,2,...,k. With this input the main program 


i? 
constructs binomial data and sends this data to subroutines 
MADSKY (Madansky), RMMLI (Easterling and Randomized Easterling), 
AMLMAN (Max. 1l'hood and Mann) and WOODBG (Log-Gamma); these 
subroutines compute lower confidence limits. For each case 
these computations are repeated 500 times. Then subroutine 
CMPARE computes the 90-th and 80-th percentile, mean, std. 

dev. and actual confidence level. 

The programs are self-explanatory since comments are 
inserted throughout the programs. Note that subroutine RANDOM 
and PXSORT are from Ref. 10, subroutine MDBETI from Ref. 3. 

The percentile points of the chi~square and standard normal 
distributions are from Ref. 8. 


The successful root finding technique in the MD procedure 


which was developed by Lisowsky (Ref. 4) is implemented in 


subroutine MADSKY. 
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